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METHOD 

(57) Abstract 

PROBLEM TO BE SOLVED: To solve a problem of a 
conventional multi-color image pickup device that 
has caused defect in image quality such as void or 
darkish image with high saturation in the case of 
generating a sensitivity value of a defective color 
component of each pixel even when the defective 
component is corrected by using a sensitivity value 
of a received color of the pixel. 

SOLUTION: The luminance of each pixel is replaced 
into a mean luminance level (R(1H), R(2H), R(3H), 
R(4H), G(1H). G(2H), G(3H). G(4H)) on the basis of a 
local luminance distribution by each reference 
color, and a sensitivity level G(R) of a deficient 
color to be interpolated is calculated on the basis 
of a line segment similarity ratio of a geometrical 
figure (pentahedron) by each color estimated on the 
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M^P^m^mn x^tzm t m-mmz^xm^-r^ r t t^x^ 
^t^. (b) <D:^{cj^. Sii:fesv^^l7K¥>^r6]^^v^-r 

[0 0 5 1] mB\%^(Dx.bf^E,f^m(DWi^^^m^m 
w^t^^^w^^^mmt\zm^\^^x^^^(o^m u-</v 
^^^-r^wM^m.m't^fz^bcommmxh^. wl^^ 

(DUmmE.f^m' (R (R) . R (IH) , R (2H) ) 
SI#^tu5l«f^<lG (H) tG (i) RV^G (j) 
(D^^i^mG (AVE) 

(G (H) . G (IH) . G (2H) ) (a, G ( 1 
H) , G (2H) iO«Sl^-</H^G (AVE) tC^L 
v^) ^tT^l^f^^W^^H^.^^L/^ilT-fc^o Rfe;6SJi^fi!c 
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2Mit^j:^. R (H) tG (H) t<Dith^mz,mm 

[0 0 5 2] t^^x\ :icomm<Dmmix'^\^ti^^ 
^(Dmm^mmw-n. tie^ (?) ti^x-mti^xm 

m-r^:Zt7^^X^^o mU. K (m, n) fi^i®^ 
(m, n) ^C:^V^T^^■r5^J£fe<^^BSl/-</^'. J 

K (m. n) =K (AVE) + { 
XC d 

[0 0 5 4] ±ft^ w(7):&5^-e^j£fe^«Pfli-ttt^, # 

^¥5- 5 6 4 4 6-^{^m-i&.^^'mm^mi^x(omi^ 

LTG (1) =4, G (3) =1. G (5) =4. R 
(2) =R (4) = 1 0 2 3r'^»:). m2RXJ^^ (7) 
t;:t^oTaS®^tC;fcttSRfe{t-^ffiR (R) ^ffmU 
G (AVE) = (4 + 4) /2 = 
R (AVE) = (1023 + 10 
R (R) =R (AVE) + {G ( 
= 1 0 2 3+ (1-4) /2 
[0 0 5 6] fl^. m5<0:7 x:i—^^— hXn. H 7 

m^xR&coiEm'^mco—m(DM^f)^G^(DiEm'^M<D 
-m(DM^<D^^^ m^^u^xit.2 : d tfj^^x^^ 

^(OX. l/2^^-r6#*:>l9l;iK^feMjE^»R 

(H) (om.^ 1 \fy hff tt*v':7 h LT^»ffi^3i^a^T 

v^6o w(7)J;pl;i. mM(omm\\z.yr^^mfii^m^nx 
-hmW-^ntyfy Vi^^ vmn(o^x^X(Dm9^^ 

^m'r^z.tt^x^^<ox\ ^^^(D:^m\z.^Wt\^xyy 

:^Txm^-r^m^\tMmmm^'^m.x^^ ^ 

So 

[0 0 5 7] ^fc. 1215(7?^1I:7U— ^{CjoV^T 
Ji, ^9^<7)5pg$^a6«3(;iR (AVE) ^R (R) t<D 

T/^V\ EP^. ;^7":y:7'ST 5(Cjt5V>rR (AVE) > 

R (R) tm^l^fz^^. ^^y'^y'ST 6\c^n^^m 

r (R (R) -R (AVE) ) /2j i^nmtfj: 

t). m^mz:z(Dm^G (h) ;6-f>«»-t--5;:^7^5/^s 
T 7 i:(^Ctg»^^;^^5o t2^oT. ^ 7=" 3/ >^ S T 5 ^IJ^ 
;^7"!yy^ST7^/^< LT^^{4=T^'r S T 6 (O?^ 

^mn'r^x^\zmm^i^xh:^^^t>fj:i\ rco»g^, 

7 a -7 c:^^h?[^nmms^mt)-r^ii^^^h^j:<ti:^o 

[0 0 5 8] m:m(Dmm2, m9\t.^<D^m(Dmm(Dm' 



(m. n) liaiMSl (m. n) t^tT^Sl^feiffig U-<yK 
K (AVE) fl^g®^(7)35^<^)M^l-S-^V>T^bn 
^^^^(D^^&W'i^m. J (AVE) li?igti|^<Z)jfi 

(^M(oj^si 1 xn^mi^^E^nm (om^misiitx^ 

So 

[0 0 5 3] 

J (m. n) - J (AVE) } 

• • • (7) 

tiWr^. UT(0^ (8) (10) (D^W^n^^t 

K^^jt^o t2^oT. ^^$ix5«rpift-^{iR (R) nm^ 
-:^mm^(Dmi^xmi^\:im'r^^ ^<Dmw^it ^ 

[0 0 5 5] 



4 • • • (8) 

2 3) /2 = 1 0 2 3 • • • (9) 

3) -G (AVE) } XCd 

= 1021.5 •••(10) 

^C^o'V^Ta^fe^fpI^[gj?^^7^^^^ J (H) (=J 

(m. n) - J (AVE) ) ^mn^^mm^mm^ 

l&) -cfcSo 

[0 0 5 9] Mri^^iat. mBmm(omm&m<o±TiE. 

30 m^i^x^mmMm^^^mi^. ^mf^m^2^(Dmm(o 
r^x<o^^&<Dm^i^^/^^^'^w\^. 
m7b^^h^\^^mtt^:^mmcDmm^m\^^x J (h) ^ms^ 

W^m±<om.^m&.\t\Z.XV. (m. n) SrSt^i-SwtJC 

^«»s-r5o 

[0 0 6 0] »:tcSif^t;ioVNTiaP^i-So dioiiro 

fc2s?>(75>^n-^^- hr-foSo :^(DmM<Dmmx\^^ m 

"TSo ^-r. G{t-^(^?£i®^tc^-rs±T2iu^<7)M 
^iSG (V) Rxj^:^i^2mm(r>m^mG (h) ^SLffl-r 

6 (;^-7"^> y^S T 8) o ^ttb^OM^fflG (V) 

^t/G (H) (DM-m^^^it^\. (;^7^:yyST9) . 

(Dfz,}^(Om^G (i) :S.r/G (J) LT?|ISLlHl^8tC 

50 ^^bTm;^-rs (;^7^3/:/ST 1 o^^ji;^7^:y T'ST 
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[0 0 6 1] ^ft. R&m<Dm^^mm^9 sL-x^n, m 

(C:}o V >T^^fi-^D fOlc^i- 6 D ^ 2 o CO ®^ 
^l^«{CUTR (i) RXfR (j) tl^xmi^T^ 
TiyyST 1 2--^7^!y:/ST 1 4) « 1B^\^. w<^)R 

(i) RV^R (j) O^pi^ffiR (AVE) ^SWL 
7^>;/:/STi5) . jl^T. H 3 <J: l^l^tcH:^?^ (R io 

(R) . R ( i) . R (j ) ) $r-^522H^?^-CS#tfe 
;tfcH:^J^ (R (R) , R (IH) , R (2H) ) (R 

(IH) , R (2H) (Dm-^m^R (AVE) t^L> 

v^) coiS$R (H) t:mnm^s\zM\^xmti'r^ (^ 

7^^:/S T 1 6— ;^7':yr7'ST 1 8) « 
[0 0 6 2] I^1t0^jll^ffiv^;5r irT% Rfe^§:*L 

13 6 (b) (om^ia-x. ^^&(D^^m&m'^t>:i^^:^ 20 
^m0ki^xmmi-tii'ix\^\ ^fc. me (c) (ommm 

[0 0 6 3] ^LT. mm<ommixnTs,&^mW'r 
^m\c^m'r^mm<Dmm^^^:^m^x^m^i^lx^^^^ 30 

Wi2x\t. »mmii^<}^fj:\^^:^iyi^(Dmm:ff\^(Dmm(om 

^<DX^ i^-^-^tj:Wm>'^mtfj:^o 

[0 0 6 41 ^fc. mm(7:>mm2\cm^x\t. tg^*-f^ 
j^7k^:^f«i(0]i:jai3j;t/iliE:^r6](^)iij») $r«:gu. ?i 

^;65iliii-r5®^^#Ii[i^fetd2o-fo31^U. -^02 

5t-UTV^-5:&^ r(7?[S'9T3^^<. 1=igi:^l^]tc^ff:U:r:: 

3: i:/ / > $r ^ ^ i6 T ib^ # a @ il ^ ^ ^ L> <lr -r 5 
mm'>>(>h*^\zMLXy<^ — >^-^y^>'t/^n\^^y<^ 
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[0 0 6 5] siso?^^3. mi 2\^:i(D^m(0mM(0 

T. 1 0{iife^$;K.fcGfe<D^^iSSu-<>ru^1tgcv-r 

(fe^5>^^S^B) . 11 
(IR. G. BO§3t^Sl^^/^t-g-^V^TGfec0^gU 
"-^/l^^^^L. Mf-Rfei3J:t/Bfe{CoV^T?^Gfe(D2 
^JCTCpf^y 6 b*5j;U5_t|a^>0'/^,^:7^{;i|2tg$;j^f. 

GfefO^^^Sl^-^v'i-^^V^T. Gfe$:gE^fet UTiS 

f}^^) xh^o ^ix)^i^<Dm&itmm(Dmm2 tmm 
x-h^o 

[0 0 6 6] mz.mm^-:>^^xmm'i'^o m^^^t^^m 
\:L-:>\^x\^mm(omm2 tmmx^K^Wim^mmir^o 

#»*l±llHlK9 a~9 c-Cfi. agM*^::r^J£Lrv^ 

§^a^fe^ffira^^-r5fci6{c#^(D2t$fe7c;^^y 6 
a -6 c (om^y"-^ ^m\^^ tmz^mwL'^mm^9 

Ki it-5i#?S"ro si^iuKi iTM^. z,fhh(D7'-^ 

^7t\z^^\^x\^^^w^^(Dmm^^^^^noo ^ 

Xh^o 

[0 0 6 7] mi 3\'XZ(DmM(DmM(Dmm3lZ:}sn^ 

mmx$y^o m\^^\^^x. Ca) nR&^^^^^mm 
\z:^^n^G&(Dmml-^^^^mn'r^m^xh^o r^ 

<Dmmi^-<^i-^mW'r^m^tfj:^. (b) (a) <d 

^^i^trmn-r^m^Xh^o B$rR(Cgtmx^r 
Rfe^:G^i:(7);^^;5-bJteSM*?iJ (^><v) (;^*5tt5G 

^^<^?^^^o (c) li (a) <7)^{cMS$n. Rfe^G 
fe^o;^;e)^^^^^iij^^iJ (9^:^) (:i:JbMt^Rfe^^^ 
•r S ® IS { ;i*5 tt 5 B feO^S i^-<>'^ SrSSp-t- -5 S-g^T-fc 
5o R^B;cB#l^x.sr ^r-B#.,tGfe^o;9^;6^b?i 

^R^<Dmmi^^^i-^mn'r^m^tfj:^o m^^ iz:sc 
r?vyr^yV Tgj co^fc^-^^^^^n, (a) t*k 

[0 0 6 8] -^rUT. H 1 3 (a) lC^i-Rfe^S3fei- 
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^) If S ^ B & ^g:3ti- ^ M« (t 5 G feOigS u 

[0 0 6 9] Gfe^S*-r^iil^{-*5tt5BfeO^Sl^ 

^ji^mis-RxfR^a^ms-i^^^i^^s^n, mis (b) (d 

323tD5$ <^;55^UV^(DT^ ^ (7) \Z:}sn^C dmitl 
(10) T-ti^v-^ hi-^tfi/ h^;65 0) irUTiH 

n^mn-r^o mi s (c) <7)Rfe$rS:5t-rsM**-*3 

10 0 7 0] J[^±(75^^^7K¥:s.t/saL*-r^(ciiiiSJ:^S 

[0 0 7 1] j^±(DXo\::. ^(ommcDmmsxn. m 

V^5^75-e. Rfe-^Bfe6C)^fe^^C*3V^TiE^fe^^PI^llJ^ 

X\ HI 13 (b) ^ (c) lc^-rj:p{c#MM*<bUT 

•9 mnmo^^mm^rf^x^mwit^m^ r t ^5-c# 

5o 30 

[0 0 7 2] t.tL. K^<O^SL^^/^^B^(Om^S,^^ 
i^ffiiltC^H-r 5 ffir«^S^O ^ o # 1> fc b -r (il 

[0 0 7 3] i^^jc. ^^^;z^fefs^^1tsms^v>5 
#^tcJt-<T7-r >-''^y:7r 1 0 f^^^S^^/hRSlcfli^J 
^;55-c#^„ 0ll;^fl. *:|IJ£(0?^1ii3tc:fctt5:7 

^ y. 4 {cga ^ V ^ ^ ^s>5t^M^ ^^tf ^ 

VC?DF*?^^I1I 1 4tC:^-t"e H(-*5V^T. (c) (OB 40 

(b) CDGfe^^^-r5®^lw:Jolt6B^C0i^gU-</U 
TGfe^5J'^5^^$tLTV^-5i£'M;6^fc6o t*^oT. (^13 

(c) ^ (b) <D^mfi^tii'^fi^i^}^\a't^ ^ti\z%tL 

oT. I^H (a) (c^i-®^(7:>fi!:«{;i:fett5Gfe^5^-^5 
1 0 \atm 1 5 t;i:^-r;t*tt(0^^^;^Gft-^g SrSai" 
>':5^' (:^^i-^)®^Jiiiiimgt?:i;<7:)T*^^coi^-rX{i so 
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1 7>r 2®*) <^®*<D7>< w^'^^r ^f+:«rai- 

[0 0 7 4] ^Ur. rcD^MtC:joV>rJlgE^fei:^^ 

mt^mmmt<omm {^^i^^]) :yirmmt^jj:.<fj:ox 

TL^5a tSoT. *:|IJfe<^?^|g 3 fi, B a y e r 
fe) ^^-r W<:y:7T{:iSfflU. :Lti^^(Di^<D±X<D 

[0 0 7 5] j^cf^b\ :i(onm(Dmmsxnmm(Dj^m2 
(Dm^:irsxv^mi'^^mmt\^xwLm\^rztK mm<Dmm 

t±-x^^. 

[0 0 7 6] i^_h£D^^goJ^^^c^ov^Tf'j:. Wim^^(om 
f^^mt x^x^mf^^mc^^^xco^xm^^h-:^^ y 

ju^^m (^$p5^^^y-rx^^) . jpegjejhi^s 

^H^a^^f^n^r ^f^MP ^T'^?^^V\ l^^d. LCD 

\^xhm^(D^mm^th^^thn^-^xhf^\^\ 

[0 0 7 7] ^7t. J^Jl(7)^TC7:)^^g(7)?i^^^;lioV^T 

^\^xm^^\^tLt^:LCOWi^Xf^< . z-^— y-r^/u^i^-t" 

mmw^mmmz.m^\.xmm.\^. :ifih(om^±.xm 
[0 0 7 8] ^^{c. y.±.(D^x(omM(Dmm\c^\^^x 

fi. 2^5fe7c»»^^2 i: UTRGB<7?^>^>fyU^^5|gii 
5|;i^i-J: p {CB a y e r m\ZMm't ^^^.tl y > 

fc;6S-co|S'9T*/.e< . mL^m^<om^±\:LW^^(D^y 
[0 0 7 9] lEt-. J^_hO^TCD^^£(7)?i^^^CioV^T 
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^ i^^/Ht i.it^-Ky u- A ^ ^ y 4 1 @ii®55'«it 

fc. :7U— i^p<^y 4;^>b^fe^2^^7t:;^^y 6 a'-e 

Sf&mS^^f 5«^^^L:^;6S. 7 a - 7 

c tm^y u-i^pt^y 4f^t^iii«7^— :?tcT^-fe:^«r 
|gi:^.^^<fc5l-1»^UTt>J:V\ 10 
[0 0 8 01 

15^ i ® * (Oifi^^ t;iffiBi- S T* o T J.O JifSii g 

^^in^mm. ^^x^. ±f^^^^^mmm(D^x<Dm 

^^blc{i«9:()S^C/iVNj: 5(-i-^r i:;65t»t. 
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[0 0 8 2] wtb^i^^fc, ±iaK^<^fe^35-<^^Si^ 

$ V ^ J; 5 ^-MiE^J^a ^^JS-r 5 w ^ 

[0 0 8 3] 19 . fE^fe^fsr^Hlff^ <^ :^Sfe^fpr^ 

mmt<om^^^mit\zm'^\^^x^Si&^mmi-^xo\:i 

[0 0 8 4] ^UT. ^(DX,of^^^^'^^f:zm:i\1i. 
[0 0 8 5] 4^1C. ^J£fe^±&U-</USIS[^^;5^ #^ 

Hjcrn^ n tf ^/ h^^ft^v'^' hmm-r^ :itxmnm 

^n^^o\^'rti\t. m^m&.it^mm^mn\^x^% 

[0 0 8 6] R^^a(Rr^EIJI^*3j:0?:^J£fe^fpr 

^mmnK\^^\z:mm^m^xhtimui^^j:^m^xh-:> 

X\ ^^&^i^i^^J\-m^^^^XXJ^^Si&W-i^\y^/l^ 

fe6o 

[0 0 8 7] Z(D^m\:i^f\.\-^. fE^fe¥*SL--<>^^SIK 

m^WL^^^mmmt\^xm^\^. ^^^w-m^^^ji^m. 
^^^m^mmmt i.xmtR-r^(Dx\ mi^^(D:^yi^& 
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[0 0 8 8] -=eL.T. fE^feT*&U-<yuSi»^©:ti«f|I;t 

[0 0 8 9] :z(o^m\:i^ti\t. ^nmm<oyFS,^^f^ 

(ommi^^/i-^^^i-^^^^^^:i7m\c^\^^x . ±fB 

^-rsMi^tT? 2»:7^ia^J^cjov^T±faa»coK^fe#^ 

ti.xmni-^^^^^i^i-^^i^i[^w:^'ry':/t. mm 

^^(ox\ m:i^^^fj:^i&.^mn^m\^^x^^mm(Dmm 

[0 0 9 0] ^^x. ±^s:^^(D^^^<Dm&i-^^i-t 
m^\at. m^(Dmm^^j:mmxnmmm-^(Dmt\^^ 

m^mr^xmE^rrb^tt^xt^o '^(om^^ ^^^(d so 
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-r^iss i^-<j^mt<oMi^t^m!^\:Liio\^xh^m<om^- 

'^m9i^^h(r>t-r^:itr^x^h^^r^^^. 
[0 0 9 1] rtt<bf^^{;i> ±.^^^(D^^ii^(om^i^ 

OSS u-</> ^ ^J£fe^55^<7)iSS u-^/u* t (D^S. u-</w 

ftmmcRft^'t^mx^m&cDms. u-<>ru^5±fsn-/^ 

[0 0 9 2] 19 . ^^^afRr^n?^ ^ ^J^fe^fpl^ 

i.it(Dx. mm^(Dmmm^^^i-<Dmmxnm'r^m<o 
mx^^tmmc. i^mmi^^ji-com^xhrnm^^x 
[0 0 9 3] z(D^m\z.xti\'t. ^mm(D^mnt ur 

-c. w^^^fii^u^n^m\^x'&,'^wn<DnWk(owm\ 

(nm^\y^J\^-k^'^^^^ht^X^^. =B^oT, 

^t'^^^\^f^\^m^'^'^^z,}it'^x^. M^omstci 

[0 0 9 4] :L(0^m'^^^\t^ S«^^;ei5 3oJ^±(D 
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■So 10 

[0 0 9 5] :l^^^eg^cJ:^^^^. ^(Dm.(o&^^^^m 

^^^mmmmt vxmi^^ti^m^commtt-m-x 
h^(Dx. ztih<o^(DyfSi&mm\z^\^^xnwt^&^ 

fi:^o ^(o'i^^. ^^^mm. mmm.m (D^mm^n 
[HI] :i(D^m(Dmm(Dmmi\zx^y'^z^^ju;^ 

[112] 2'^jxML^n=t<0'Q aye r MiE^^UlC^ott S 

[n 3 ] :L(D^m(Dmm(Dmm 1 (T^R^^co^^sim 

So 

m4] 2Kk7tm^m^(OB aye r ^i£3?IJ{C:Jott S so 
[(gl 5 ] r to J; ^ /c^^{4^iDTT'?ig M^cDG^^^^G 

(R) ^^iib^tzi^\zm^mmi)mm-r^^j^^±mm 
[igi6] :z(Dmm<Dmmi\^:}si^x. ^mm\zm^x 

[US] r (oj: 5 ?iH^?^tDgE^feafRr^igi?i^^^j£ 

[H 9 ] r 2 d J; 5x >f i^^/i^:^ 

[Hi 0] :^(D^m(omm<omm2\:i^:b^Mnm^ 

[Hill] C<^^igc0^]teC0?f^te2O#.^S[miHlg&;65 so 
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[Hi 2] r(7)^§g(7)^i£o?^ffi3fc:j:S7^>f v^^/i- 
[His] r(^^0^(D^M<D?]^ffi3 lc:Jo{tS#HSiij^ 

So 

[Hi 4] rC>^5^0^J6(OJgffi3fCibMtS:7ix-iH 

[Hi 5] :i<o^m(omM(oj^m\^^\'^ 

yyr(o^m.^m^m.m'r^f:L^(DWimmxh^o 

[Hi 6] *«^2iSfe7n»«^-^fCiDV>T-fi^WtCffl 
V^b;^^TV^SB a y e r (-<>f-y-) ^lE^iJtC J; Si^fe 
:7 Y ^^-r H -C S e 

[Hi 7] Bayer WMm^ ^^W.^ 

^(Drnmrnxth^o 

[HIS] Bayer (-<>r-V-) ^lE^lJi^JcSIlfe 

y>(j\-^^m^^^fz.m^\^nhf\.^^^^^(o^itmm^ 

[H19] Bayer (-^^ i--) ^iE^lJIC J: SMfe 

[H2 0] 2^vmmM^\^K. G, B 3j!^^;b^^/.C 
Sfe:7.</Ui$7^B aye r MIE^IJTSfift bfci:^7 ^ — t'x 
p« 7 tC, 5-5 6 4 4 6 -^^^iCiSSt L 

[H2 1] H2 0CO2^7t:7«^y (1^^) f^CO#ti^ 

[H22] H2 0(7)215fe7TCP«-=ey (i^lH) I^tT^Sti^ 

(-95) ^^i-|5^?^HTfeSo 
[H2 3] H2 0C0 2^$^7t;p«^y (Wffi) rtco»ti^ 

[H2 4] m2 0<D2^7x:T2-'y<:;^y {^m) 

(omtim^Tn^m^mx^^. 

[H2 5] m2 0(D2^7x:u—y<ysy^j\^^ mm) 
(omt^m^yr^ir^mmx^^o 
[H2 6] m2 0(D2^7z^—^<ysy i^m) 

(omf)mt:7r^^mmmx^^, 
[H2 7] z.<om^<o 2-o(Dm^:hmz^^±^mm 
m^(omm\^^^^^im,^m'r^fz}^<Dmmmx^^, 

[H2 8] 4#^^5-5 6 4 4 6 -^^^(7)fflr«1:j5-fefC 

*3 1 1 s ® s^feML ^m^m-r^tz^comMmx'h^o 

1 l/VX (m^-^) . 2 2^5^7ra^^^ 

. 3 A/D^mS (m^^) > 7 a- 7 c, 9 

a - 9 c ^Mnmm^ {Wt^^W-^ l^-</l-SISt#^. 

TF^^ijZij^ U-<yl.it»^S) . 8, 11 ^SmiHlK 
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